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'  INTRODUCTION. 

~  *  The  United  States  Army  Infantry,  Board  is  currently  conduct¬ 
ing  a  5-year  Infantry  Weapons-  Methodology  Study.  The  aim-  of  the 
methodology  study  is  to  .provide  test  procedures  and  techniques  which 
will  insure  the  selection  of  the  most' effective  weapons  and  equipment 
for  the!  .Infantry  soldier.  The  approach  of  the  methodology  study  was- 
to  cast  these  procedures  in  terms  of  the-  environment  in  which  the 
camdrda.te’  weapWs  and  is'uppdrt  equipment. -wilt  he  used-*  Since,  a  reaT^ 
istic  evaluation  of  weapon  performance  cannot  'be  -undertaken  with 
validity  in  a  sterile  laboratory  situation,  the  movement,  in  recent 
years  has  been  towards  tactical  or  operational  testing.  This  paper 
wi&b  relatej^some  of  the  results  thus  far  achieved  and  wirft*  emphasized 
in  particular  a  new  analytical  technique  for  isolating  particularly 
important .variables  or  measures  of  effectiveness . (  }  _ 


An  objective  of  the  anethodo logy  study  is  to  evaluate  system-’  ~  ‘  | 

atically  those  factors  which  influence  the  combat  environment  by  I 

using, the  scientific  method  for  as  much  objectivity  as  possible. (1)  .1 

To  relite  the  test  environment  to  the  combat  environment  for  the  <$ 

rifle  portion  of  this  study,'  a  listing  of  the  various  combat  actions  ,T 

and  tasks  normally  accomplished  by  the  Infantry  was  prepared.  As  a  | 

result  of  this  research,  26  separate  combat  actions  were  identified,  | 

such  as  counter ambush,  close  combat,  frontal  attack,  etc.  Next,  °| 

after  researching  pertinent  doctrinal  and  straining  literature,  a 
list  of  tasks  normally  accomplished  by  the  Infantryman  when  executing 
the  combat  actions  was  .prepared. (2)  These  include  such  actions  as  | 

medium  to  short  range  sustained  fire,  rapid  reaction  firing  and  close 
range  high  intensity  fire.  It  was  determined  that  three  basic  tac-  4 

tical  situatiqns  (attack,  quickfirc,  and  defense)  would  accommodate  ,  I 

the  26  combat  actions,  as  well  as  the  23  combat  tas  <3Ttis  docus  'approved  J 

for  public  robcaa  ,  solo;  iW 
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Thirty-six  measures  of  effectiveness  were  developed  from 
a  consideration. of  the-e  combat  actions  and'  tasks  which  reflect 
soldier/weapon  system  performance  under  combat  conditions..  Examples 
of  these  are:  time;  to  irst  round,  time  between  trigger  pulls,  dis-  - 
tribution  of  near  misses,  time  to  shift  fire,  and  hits,  per  pound 
expressed  as  a  percent  of  the  soldier's  basic,  load.  These  replace 
the  relatively  sterile  measures  previously  used  with  the  service  test 
and  evaluation  of  weapon  systems,  such  as  the  stationary  bull's-eye  _ 
target  associated  with  the  old  icnown-rdistance  ranges-.  The  new  meas¬ 
ures  provide,  definitive  descriptions  related  to  weapon  performance 
which,  assist  the  -decision-maker  in  selecting  the  best  of  several 
competing  weapon  systems.  ,  -  C 

Another  result  of  the;  testing  thus  far  has  been  the  devel¬ 
opment  of  a  new  technique-  for  relating,  these  specific  measures  to 
combat  effectiveness.  If  successful,  this  new  method  will  isolate 
the  more  important  measures  so  that  their  impact  on  the  decision¬ 
making  task  will  have  a  weight  proportional  to  their  importance  in 
the  combat  environment.  The  paragraphs  below  describe  comparative- 
weapon  performance  when  some  of  the  hew  measures  are-  used,  and  the 
technique  for  determining  the  relative  value  of  these  measures  as 
.predictors  of  weapon  performance. 

EXAMPLES-  OF  OPERATIONAL  MEASURES  ■  OF  EFFECTIVENESS 

-  *  <>  - 

The  purpose  of  Quick-fire  Experiment  I  was  to  identify  and.- 
isolate  factors  critical  to  man/weapon  system  evaluation  and  to  -  •  . 
develop  methods  for  quantitatively  measuring  those  factors. (3)  Two 
examples  of  these  new  measures  of  effectiveness  are  presented  below. 

The  test  vehicles  were  two  different  automatic  rifles.  While  the 
results  appear  to  address  the  performance  of  -these  two  weapon  systems, 
the  aim  of  this  paper  is  to  demonstrate  the  capability  of  the  test 
facility  to  resolve  statistical  differences  between  weapon  systems-r 
not  to  evaluate  the  relative  merits  of  the  tested  weapons  used  in  the 
quick-fire  experiment. 

Tx-ie-To-First-Round^  The  time  to  fire  the  first  round  is 
defined  as  the  time  period" between  the  instant  when  a  target  appears 
and  the  instant  the  first  .round  is  fired.  The  timerto-firstrround, 
is  indicative  of  the.  actions  necessary  for  a  soldier  carrying  his\ 
rifle  at  the  ready  position,  to  acquire  and  engage  a  surprise  target. 
Time-to-first-round  measures  , the  soldier's- actions  of  bringing  the 
weapon  to  his  shoulder,  seating,  the  stock  against  his  shoulder, 
aligning  his  head  sc  that  the  sights  are  placed  in  a  line  between 
the  eye  and  the -target,  aligning  the  sights,  acquiring  a.  "sight 
picture,"  and  squeezing  the  trigger.  Should  the  design  of  the 
weapon  inhibit  any  of  these  actions  by  the  soldier,  the  effects 
.should  be  reflected  by  this  measure.  The  quick-fire  test  facility 
was  able  to  find  statistically  significant  differences  between  the 
two  candidate  test  rifles  of  less  than  three  tenths  of  a  second  for 
specific  engagements. 
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Graphical  presentation  of  time-to-first-.round  as  a  function 
of  range  is  shown  in  Figures  i  and  2.  It  can  be  seen  that  Rifle  A  is 
faster  than  Rif le  B  and  that  both  weapon  systems  fire  more  rapidly  in 
the  automatic  mode  than  in  the  semiautomatic  mode.  Performance  at 
specific  ranges  is  not  notably  different,  although,  in  general,  the 
mean  values  increase  with  range.  The  important  factor  from  the  view¬ 
point  of  test  methodology  is  that  a  specific  hypothesis  can  be  con¬ 
firmed  or  rejected  with  respect  to  which  weapon  characteristics 
contribute  to  speed'  in  .firing  the  first  round.  In  this  test,  it  , 
could  be  hypothesized, that  Rifle  B,  the  low  recoil  weapon,  would  be 
the  faster  weapon.  The.  test  results  do  not  confirm  this  hypothesis 
but  show  that  the  heavier  weapon  is  approximately  three,  tenths  of  a 
second  faster,  which  ia  significant  at  the  5-percent  level.  Weapon 
weight  and  low  recoil  may  in  fact  contribute  to  speed.  Therefore, 
some  other  variable  or  characteristic  of  these  two  weapons  systems 
must  have  an  overriding  Influence; 

(  y  j  t  i  J 

It  is,  of  course,  possible  to  theorize  as  to  the  cause  for 
the  observed -differences.  -For,'  Sample,  sighting'"  systems  may  be 
responsible  for  rifle  differences;  Rifle  B  has  elevated  sights  which 
may  prohibit  the  firer  from  using  the  barrel  as  an  aiming  aid  and 
therefore  may  be  less  suited  for  the  quick-kill  or  rapid-fire  tech¬ 
nique  than  Rifle  A.  With  reference  to  the  differences  between  modes, 
theremay  be  a  characteristic  psychological  factor  which  induces  more 
deliberation  in  the  semiautomatic  mode.  The  firer  may  feel  less  .need 
".to aim "carefuldor ^wben-fifing  in  tbe  automatic  -mode  since  r'  ‘*peTs 
tnat  this  mode  offers  greater  fire  power— enough  to  compensate, for  a 
^  hasty  trigger  pull.  However,,  other  measures  such  as  hit  probability 
show  that  the  automatic  mode  is  much  less  effective  than  the  semi-  . 
automatic  mode.  This  difference  will  be  discussed  later  under  the  »'• 
".analysis  of  burst  size. 

Time-Between^Trigger-Pulls .  The  term  time-beeween-trigger- 
pulla  has  been  adopted  so  ’that  reference  cculd  be  made,  to  both  auto¬ 
matic  and’  semiautomatic  modes  of  fire  with  the  same  term.  (Normally, 
the  terra  tirae-between- bursts  was  used  for  automatic  fire,  and  time-; 
between-rounaa  was  used  for  semiautomatic  fire.).  The  term  is  used, 
as  an  indicator  of  the  soldier's  ability  to  absorb  the  recoil,  re¬ 
acquire-  the  target,  obtain  a.  new  sight  picture,  or  point  the  weapon 
and  squeeze  the  trigger;. 

Figure  3  presents  results  of  the  time-be tween-bursts  analy¬ 
sis.  The  figure  shows  a  25-?percent  difference,  significant  at  the 
5*percent  level;  between  the  two  weapon  systems  indicating  that. this 
measure  has  some  degree  of  criticality  to  weapon  performance  evalua¬ 
tion  in  the  automatic  mode.  No  significant  differences  were  observed 
in  the  semiautomatic  mode. 
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EFFECTIVENESS  'EVALUATION'  ‘  V- 

-The  development  of  these  measures- of  effectiveness  has -pre¬ 
sented  the  decision-maker  with  -quantitative  measures  of  weapon  per¬ 
formance  obtained  iipaiy  operational  environment.  This  development 
-represents  a  distinct  advance  In  objective  evaluation  but  in.  turn 
poses  a  hew  question:  ‘Which  of  these  measures ’should  receive"  the 
most  weight  in  the  process’  o.f  choosing  the  optimum  weapon  system, 
especially  when  one  candidate  weapon  proves -superior  in  some  meas¬ 
ures  and  inferior  in  others?  Specifically,  the  basic  problem  is  to 
relate  differences  found  within  the  various  measures  of  effectiveness 
to  meaningful  differences  inthe  real  world.  In  other  words,  should 
one  weapon  prove  to  be  1.2  seconds  faster  with  such  a  measure  as 
time-to-shift-rfire,  how  does  this  difference  relate  to  the  success 
or  survivability  of  the.  soldier /weapon  system  in  combat,  and  how 
should  such  a  difference  be  equated  to  differences  in  other  measures 
such  as  hit  probability-? 

.  '  1;* 

The  paragraphs  that  follow  describe  an  approach  to  the 
question  of  how  to  relate  the  measures  just  discussecUto  operational 
effectiveness.  It  is  expected  that  this  new  appr.oach'will  be  the 
sfte.pping  stone  to  the  problem  of  weighting  the  various  weapon 
measures.  .  .  =  ~  •  r-)' 

The  firing  engagements j  whose^refiults  comprise  the  data 
base,  are  categor ized  according  to  the- degrees  of  effectiveness  as 
def  ined==by -whether -or-no t  =the-f i-rer  achieved1  a  hife-dur-ing-the  quicks 
fire  engagement.  Those  engagements  which  requii'ed  multiple  trigger 
pulls  (more  than  one  fpimd\.in  ,seirilautqmatic  of  one  burst  of  auto¬ 
matic)  and  failed  to  achieve  a  jjftit  ;/ire  defined  as  the  least  effective 
engagements;  those  which  resulted"  in  a  hit  whether  single  or  multiple 
trigger  pulls  were  required  are  defined  as  most  effective  engagements. 
A  figurative  presentation  appe’ars  ih^Figurev/K>^- - --  * 

Level  3-  is  considered  -to  be  the  center  point  on  the  scale 
since,  it  contains  all  engagements  observed- during  the  quick- fire 
field  experiment.  Level  ljis  the  least  effective  set  since  it  con¬ 
tains  all  engagements  in  which  the  firer  pulled  the  trigger  more  then 
once-and  failed  to  achieve  a,  hit.  In  other  swords,  level  1  results 
when"  all  multiple  trigger  pull  engagements  in  which  a  hit  did  not 
occur  are  removed  from  level  3.,'.  Level  5  includes  all  engagements 
from .level  3  that  resulted  in  a.  hit  on  a  target.  Level  5  is  defined 
as  containing  the  most  effective  engagements,  and  is  the  highest  point 
on  the  effectiveness  scale.-  Levels  2  and  4  are  special  cases  com¬ 
prised  of  engagements  which.  c:,an  be  placed  intuitively  on  the  scale 
somewhere  between  levels  I  and-  3  and  levels  3  and  5,  respectively. 
Level  2  uses  the  same  engagements  for  its  data  base  as  level  3,  but 
all  single  trigger  pull  engagements  have  been  removed.  Since  the 
targets  disappeared,  when  hit  so  that  first  round  or  burst  hits  ter « 
minated  the  engagement,,  the  .assumption  is  that  soldiers  who  fired: 
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only  once  were  apt  to  be  ;more  successful  than  soldiers  who  continued 
to  fire..  Level  4- -consists  of  the  same  set  of  engagements  that  com¬ 
prise  level  t  except  that  one  round  or  burst  engagements  that  resulted  ' 
-in  a  hit  have  been  removed;.  ‘The  assumption  is  that  engagements  that 
resulted  in  a  hit  but  required  repeated  firings,  are  less  effective 
than  single  trigger  pull  engagements  that,  resulted  in  a  hit.  The 
figure  explains  how  the  five  levels  are  related.  The  scale  is  an 
ordinal  scale  which  simply  ranks  the  five  levels.  The  distances 
between  the  levels  on  :the  scale  are  unknown,  i.-ej,  level  4  cannot 
be  defined  as  four  times  more  effective  than  level  1; 

The  number  of  measures  which  can  be  used  to  evaluate  weapon 
performance1  varies  from  level,  to  level'.  For  example,  the  measure, 
time-to-firsf-rliit  is  only  produced  during  engagements  in  which,  a  -hit 
occurred  and,  consequently,  is  hot  present  in  level  1.  Figure  5 
shows  the  measures  that  are  associated  with  each  of  the  five  levels. 
Generally,  as  effectiveness  increases  more  measures  become  available 
for  the  evaluation  of  weapon  performance. 

Once  this  effectiveness  scale  was  developed,  several  meas¬ 
ures  were  analyzed  to  determine  how  the  measure  related  to  combat 
-effectiveness  as  defined  by  ,the  effectiveness  scale.  An  example 
that  proved  to  be  closely  correlated  to  effectiveness  was  the  size 
of  an  automatic  burst  of  fire  when- a  soldier  engaged  a  target  using: 
the  fully  automatic  mode  of  fire.  Figure  6  shows'  burst  size  for  the 
two  tes£  weapons  plotted  on  the  effectiveness  scale.  The  curves 
show:  that  for  engagements -with-  no^hits-  there-  is  relatively  little, 
difference  as  far  as  burst  size  is  concerned.  As  engagements  become 
more  effective,,  Rifle  A  tends  toward  2- round  bursts  while  Rifle  B 
tends  toward  the  3-round  burst.  This  indicates  that  burst  size- plays, 
an  important  role  in  the  manner  in  which  soldiers-  effectively  employ 
rifles  in  the  automatic  mode.  Soldiers  who  fire  Rifle  A  in  2-round 
bursts  get  significantly  more  hits  on  targets  while  -those  who  fire 
Rifle  B'  in  3-round  bursts  achieve  more  hits.  In  statistical  lan¬ 
guage,  an  interaction  has  occurred  between  real  world  effectiveness, 
as  defined  by  the  scale,  and  burst  size. 

This  discovery,  made  through  the  detection  of  interaction 
effects  (4),  suggested  that  a  more  thorough  analysis- ,df  burst:  size 
would  lead  to  a  better  understanding  of  the  factors  which  contribute 
to  the  combat  effectiveness  of  the  soldier/weapon  system. ‘  The-  first 
step  was  to  examine  the  size  of  the  bursts  which  soldiers-  fired*  in 
the  automatic  mode.  Figure  7  shows  the  results  of  each  automatic 
mode  trigger  pull  observed  throughout  the  quick- fire  experiment.. 

The  average  burst  size  for  Rifle  A  was  2.27  rounds,;  for  Rifle  B  the 
average  was  2.78  rounds.  Burst  hit  probabilities  for  the  two  wdap'= 
ons  are  shown  in  Figure  8.  The  analysis  thus  far  fails,  to  show  a\ 
difference  in  effectiveness  between  the  two  rifles.  Consequently, 
further  analysis  of  burst  size  was  attempted. 
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The  next  .effort  was  to  examine  the  individual  effectiveness 
of  each  round  of  the  different  burst  sizes;  these  are  shown  in 
Figures  ?  and  10.  The  highest  single-round  effectiveness  for  both 
weapons  is  achieved  .with  the  single  round  of  a  semiautomatic  trigger 
puli.  The  second  most  effective  round  for  Rifle  A  is-  the  first  round 
of  a  2-round  burst;,,  the  same  phenomenon  for  the  first  round  of  auto¬ 
matic  fire  for  Rifle  B  was  not  observed.  It  could  be  expected  that 
all  first  rounds  of  a  burst' and  the  single  round  of  a  semiautomatic 
trigger  pull  would  be  identical  in  terms  of  the  probability  'Of 
achieving  a  hit.  The  effort  required  to  acquire  a  target,  position 
the  weapon,  align  the  sights,  and  squeeze  the  trigger  are  exactly  the 
same  regardless  of  the  mode  or  the  number  of  rounds  that  follow  the 
first  round j  These  data  do  not  support  this  reasoning  and,  in  fact, 
show  that  firs V round  effectiveness  is  related: to  the  number  of 
founds  that  follow  and  the  effectiveness  of  the  following  rounds. 
Generally,  individual  round  effectiveness  drops  very  rapidly  as  the 
burst  of  fire  continues  in  a  quick-fire  engagement.  Bursts,  of  four 
or  more  rounds  are  relatively  ineffective  against  point  targets. 

The"  comparative  effectiveness  of  each  burst  or  automatic 
trigger  pull  can  be  seen  in, Figure  11.  This  figure  shows  the 
cumulative  hit  probability  of  each  round  within  the  burst.  Cumu¬ 
lative  hit  probabilities  show  very  clearly  that  burst  size  is 
related  to  the  ability  to  hit  a  point  target.  Without  the  burst 
analysis  no  difference  between  weapon  systems  was  observed  (see 
Figure  8).  From  the  burst  analysis,  the  most  effective  weapon 
system  is  Rifle  B'  ifi  the  3- round  burst  mode.  .Since  firing -tfe'ph-— 
niques  can  be  ^improved  by  training,  the  potential  of  Rifle  B 
appears  to  be  greater 'than  that  of  Rifle  A  as  an  automatic  fire 
weapon.  >  '  '  '  ^ 


Two  important  findings  have  materialized  from  the  burst  ■ 
analysis  that  were  not  among  the  original  objectives  of  th'e\ quick- 
fire  experiment:  The  Service  Test  must  determine  the  weapon 
system's  optimum:  operating.  .mo_de  to  .yield  complete  information  on 
weapon  potential,  and  training  procedures  are  related  directly  to 
weapon  performance  and  therefore  should  not  be  considered  as 
separate  entities.  These  are  examples  of  .the  indirect  benefits' 
from  a  study  based  on  a  solid  methodological  foundation. 

This  technique  of  equating  a  specific  measure  to  real  world 
effectiveness  represents _ an  advance  in  military  test  procedures,  but 
is  limited  in  -.that  the  "real  world"  is  still,  a  simulated  combat 
firing  facility.  Still,  even  with -its  limitations,  the  combat  test 
facility  is  a  dynamic  test,  environment,  a  model  that  brings  into 
■play  many  of  the  influencing  variables  common  to  the  combat  environ¬ 
ment,  and,  as.  such,,  provides  a  distinct  improvement  in  operational1 
testing.  The  extent  to  which  these  measures  influence  effectiveness 
-can  be  used  as  a  method  of  weighting  the  measures  to  permit  proper 
emphasis  when  weapon-selection  decisions  must  be  made. 
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^  »  SUMMARY 

All  managers,  whether  in  business,  government,  or  the  mili¬ 
tary,  are 'faced  with  the 'sane  task:,  the  accomplishment  of  their 
objectives  with  the  most  efficient  utilization- of  resources.  And, 
the  problem  that  ail'  managers  have  in  common  is  to  relate  their 
decision  criteria  to  their  goals ,*  For  example,  a -corporation 
executive  must  'relate  such  measures  as  cost  of  labor  and  material, 
labbri 'turnover;,-  trainings  costs,  and  equipment  depreciation  to  a 
thing- called  profit.  A-  weapon  designer  or  test  officer  must  relate 
such  measures  as-  holes  in  targets,  f  atq.-  of  fire,  timeliness  of  fire, 
malfunctions,  and  cost  of  production' to  a  1  thing/ called*  success  in 
the  combat  environment.  To  accomplish  this  task:  managers  must 
bridge  the  -gap,  between  what  he  can  measure  and  what  the  system  being 
measured  is:  expected  to:  accomplish  in  the  real  world.  This  paper 
•describes  an  attempt  to -reduce  this,  area/ of  subjectivity  by  demon¬ 
strating  a  method  which  relates  one  measure^to  one  scale  of  effec¬ 
tiveness,  Butj  if  one  scale  can  be  developed  so  can  others.  Perhaps 
stale?  can.  be  developed  which  wili-relate  time,  malfunctions,  and  . 
ammunition5 expenditure  to  Weapon  effectiveness  on  this  dynamic 
testing  model,.  •  Finally,  as  scales  are  developed  they  may  eventually 
be  related  to*  each1other.  Then  the  measures  which  we  refer  to  by 
the  general  categories  of  .responsiveness,  accuracy,  reliability, 
sustainability  can  be  equated  against  each  other  reducing  to  an 
absolute  minimum  the  nranager 1 s,  need j to jnake  subjective  decisions. 

If  successful7,,  the  scaling  technique,'  basedonthe  detection  of 
interactions,  will  provide  the  manager  with  a  powerful  new  decision¬ 
making  tool, 
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